我们提出了一种降低概率图形模型中普遍存在的吉布斯(Boltzmann)分布的分区功能(标准化常数)的计算复杂性的新方法。 Gibbs分布的实际应用的主要障碍是需要估计其分区功能。在解决该问题的情况下,本领域的状态是多级算法,其包括冷却时间表,以及时间表的每个步骤中的平均估计器。虽然这些算法中的冷却时间表是自适应的,但平均估计计算使用MCMC作为黑盒以绘制近似样本。我们开发了一种双重自适应方法,将自适应冷却时间与自适应MCMC平均估计器相结合,其数量的马尔可夫链步骤动态地适应下面的链条。通过严格的理论分析,我们证明了我们的方法在几个因素中优于最新的技术算法:(1)我们方法的计算复杂性较小; (2)我们的方法对混合时间的松散界限敏感,这些算法中的固有组成部分; (3)我们方法获得的改进在高精度估计的最具挑战性方案中特别显着。我们展示了我们在经典因素图中运行的实验中的方法的优势,例如投票模型和ising模型。
translated by 谷歌翻译
Most AI systems are black boxes generating reasonable outputs for given inputs. Some domains, however, have explainability and trustworthiness requirements that cannot be directly met by these approaches. Various methods have therefore been developed to interpret black-box models after training. This paper advocates an alternative approach where the models are transparent and explainable to begin with. This approach, EVOTER, evolves rule-sets based on simple logical expressions. The approach is evaluated in several prediction/classification and prescription/policy search domains with and without a surrogate. It is shown to discover meaningful rule sets that perform similarly to black-box models. The rules can provide insight into the domain, and make biases hidden in the data explicit. It may also be possible to edit them directly to remove biases and add constraints. EVOTER thus forms a promising foundation for building trustworthy AI systems for real-world applications in the future.
translated by 谷歌翻译
Nesterov的加速准牛顿(L)Naq方法已经显示出在几个神经网络(NN)应用中使用Nesterov的加速梯度加速了传统(L)BFGS准牛顿方法。然而,每个迭代的两个梯度的计算增加了计算成本。动量加速的准牛顿(MOQ)方法表明,Nesterov的加速梯度可以近似为过去梯度的线性组合。此摘要将MoQ近似扩展到有限的内存NAQ并评估函数近似问题的性能。
translated by 谷歌翻译